Correlation entropy of synaptic input-output dynamics 
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The responses of synapses in the neocortex show highly stochastic and nonlinear behavior. The 
microscopic dynamics underlying this behavior, and its computational consequences during natural 
patterns of synaptic input, are not explained by conventional macroscopic models of deterministic 
ensemble mean dynamics. Here, we introduce the correlation entropy of the synaptic input-output 
map as a measure of synaptic reliability which explicitly includes the microscopic dynamics. Apply- 
ing this to experimental data, we find that cortical synapses show a low-dimensional chaos driven 
by the natural input pattern. 

PACS numbers: 87.19.La, 05.45.Tp, 87.80.Jg 



I. INTRODUCTION 

The excitatory cortical synapse is an example of a 
nonlinear biological system with a high level of intrinsic 
noise. This leads to a complex relationship between the 
input - the times of presynaptic action potentials (APs) 
- and the output - the variable amplitudes of excitatory 
postsynaptic potentials (EPSPs). The underlying mecha- 
nisms of this dynamics are not well understood. However, 
cortical synaptic transmission has been studied exten- 
sively by measuring the ensemble mean responses to short 
stimulus trains. Such responses show short-term 'plastic- 
ity' or activity-dependent changes, both augmenting and 
depressing 0, S S S H i as do measurements of field po- 
tentials, which represent the spatial average of EPSPs in 
a large population of synapses, all driven with the same 
timing Q- 

Current models of the dynamics of short-term plastic- 
ity are mean-field approximations 1, 2, 3], systems of de- 
terministic differential equations describing the average 
flux of transmitter between different functional pools. In 
this treatment, the large 'synaptic noise' around the en- 
semble mean of individual responses is considered to be 
extrinsic to the underlying dynamics of the synaptic re- 
sponse. In fact, though, it is known that the trajectory of 
individual responses contains a large amount of (at least 
short-term) predictability or determinism which is lost 
by the averaging of responses. For example, immediately 
following a failure to release transmitter in response to a 
presynaptic spike, there is a greatly raised probability of 
release at a closely-subsequent spike, and vice versa (e.g. 
0). 

As a consequence, characterizing the input-output dy- 
namics of the synapse by the deterministic dynamics of 
the ensemble mean does not capture the full predictabil- 
ity of the synapse. From a neurobiological point of view, 
a useful goal in understanding the operation of neural cir- 
cuits is to estimate the rate at which predictability is lost, 



or cquivalently the rate of production of new information 
by the dynamics of individual synapses, during natural 
sequences of input. Our aim here is to do this in a way 
which captures nonlinear correlations in the fluctuations 
around ensemble mean responses, which embody much of 
the predictability of synaptic transmission. In addition, 
this will shed light on the dynamical nature of synaptic 
transmission. For example, do the noise of the input and 
the intrinsic noise of the synapse result in behavior like 
stochastic chaos 8]? In this study, we describe a general, 
nonlinear approach to this problem, using the correlation 
entropy of the input-output map of the synapse. 



II. CORRELATION ENTROPY ESTIMATED 
FROM INPUT-OUTPUT TIME SERIES 

A sequence of synaptic responses to an arbitrarily- 
timed spike-train input may be thought of as a map from 
input-output history to the amplitude of the next event: 



where 



hi i-> A i+ i 

hi = [A? 1 ; At?] 

= [Ai— ro+li At— m+2j >Ai. 

Atj_ n _|_l, Ati- n +2, Ati 



(1) 



(2) 



and m is the number of amplitude dimensions, n is the 
number of interspike interval dimensions in the history, 
A represents the amplitudes and At the intervals pre- 
ceding each response. Equivalcntly, hi h- > hi + i defines 
the dynamics in an input-output time delay space (see 

SG3). 

The correlation entropy Ki is a lower bound for the 
Kolmogorov-Sinai entropy of a dynamical system 
which can be calculated from correlation sums. We ex- 
tend the definition given in [Tl| to this bivariate, input- 
output process, distinguishing input (time intervals) and 
output (amplitude) dimensions. Let 
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FIG. 1: Input-output recurrence plot of synaptic transmission 
data. Stimulation parameters as in Fig. BE, D-E. A: Excerpt 
of a recurrence plot for neighborhood dimensions e = 0.35 
mV, S = 290ms. Matrix elements [i,j] are colored black when 
6(e - ||Aj - Aj||)G(5 - ||Atj - At 3 ||) = 1. m = n = 2. B: 
Cumulative logarithmic histogram of diagonal lengths in a re- 
currence plot of a complete time series (30 mins) . The corre- 
lation exponent of the joint input-output process is estimated 
from the slope of this plot (1.75). 

The first term is the correlation exponent for the joint 
input-output process, while the second term is that for 
the input process alone. Then the correlation entropy of 
the input-output process 

K% = lim lim lim /i(m,n, <5, e) (4) 

m,n— too S,e— *0 N^ca 

where N is the number of data points. The correlation 
sums are given by 

N N 

e(e-||Ar-Af ||)e(5 -||At?-At?[|) (5) 

i=Xj=i-\-X 

N N 

C(n,5) = ——-Y,i: e(f-||At?-At?||) (6) 

v ' i=ij=i+i 

where is the Heaviside step function, || • • • | denotes the 
maximum norm and e and S are the neighborhood extents 
in amplitude and interval dimensions respectively. K2 
measures the uncertainty per synaptic event in the post- 
synaptic potential from the entire dynamics of synaptic 
transmission while subtracting the input uncertainty. It 
is useful to examine the convergence behavior of /i, the 
estimate of K 2 , as a function of the output neighborhood 
size (e). As the neighborhood shrinks, /1 for stochastic 
processes approaches infinity, or for chaotic deterministic 
processes, a finite positive value 0,0,^3- For small 
extrinsic noise, for example, it is in principle possible 
to separate the entropy that is due to deterministic dy- 
namics from the noise, and to estimate the noise level 
as the neighborhood radius below which fi starts to rise 
sharply. We used a method that estimates fi from the 
slopes of the logarithmic distributions of diagonal lengths 
in recurrence plots (RP)|14|. rather than directly from 
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FIG. 2: Input-output correlation entropy of the noise-driven 
logistic map (eqn. 0. Time series consisted of 5000 points, 
and results from 500 trials were averaged. Symbols denote 
various noise levels relative to the standard deviation of the 
unperturbed map a^/<J up : — 0.5, < — 0.25, o = 0.01, 
m = n = 6. x = 0.7, a = 4 (A,B) and a = 3 (C,D). A: fi 
as a function of e for S — > B: /x as a function of e estimated 
solely from the output time series (8 — > 00). C: As A but for 
a = 3 D: As B but for a — 3. 

Eqns. The RP is a matrix representing similarity 

in local history between all pairs of embedding points in a 
time series (Fig.[D^). This method is robust against slow 
nonstationarity in the data [TBj, and is also computa- 
tionally efficient, since it requires only one calculation of 
the distances between points at a low embedding dimen- 
sion. As expected, the distributions of diagonal lengths 
could be fitted very well with an exponential, allowing 
unambiguous measurement of the correlation exponents 
(Fig. Hp). 



III. THE NOISE-DRIVEN LOGISTIC MAP 

In this section we illustrate the method using the lo- 
gistic map perturbed with noise in each iteration. This 
is given by 

= \\a(xi + d)(l -Xi- £j)|| mod 1 (7) 

Here the noise values £„, drawn randomly from a Gaus- 
sian distribution with a standard deviation o^, corre- 
spond to the input time series Ati above. Analogously 
the output time series is given by the set of x n , corre- 
sponding to the set of A,. First, we chose xq = 0.7 and 
a = 4, which produces a chaotic process in the unper- 
turbed case. 

The profile of the convergence of fi as e, the output 
neighbourhood radius, approaches zero is illustrated in 
Fig. |21 at three different strengths of the driving noise 
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FIG. 3: Synaptic transmission at a cortical synapse. A: 6 consecutive postsynaptic responses (top) and ensemble mean response 
(bottom, 50 responses) to the presynaptic stimulation pattern indicated below. B: Whole-cell recording in synaptically coupled 
pyramidal neurons of the rat cortex. C: A segment of a continuous recording showing evoked and spontaneous EPSPs (upper 
traces) during naturalistic stimulation (APs in lower traces) with parameters: R p = 30Hz Xb = 0.2Hz Tb = 200 ms, average 
rate 1.2 Hz (see text). D, E: Corresponding distributions of interspike intervals (D) and postsynaptic EPSP amplitudes (E) 
for an experiment lasting 30 minutes. 



<7£ . Fig. [2K shows the profile for the input-output cor- 
relation entropy. When 6 approaches zero (in this case, 
S = 9 • 10 ~ 5 ), i.e. when input dimensions are included 
in the trajectories for the entropy estimation, fi clearly 
converges to a plateau value. In contrast, for 5 = oo, 
i.e. when the input dimensions are ignored and /z is cal- 
culated conventionally from the Xi alone, convergence to 
a plateau is not apparent except at almost zero pertur- 
bation amplitude (Fig. 03), since it is masked by the 
effect of the 'unknown' input noise, which causes fi to 
rise as e — > (see [l4| for discussion). Thus using the 
input-output method can use process noise when it is 
actually known, i.e. when it is 'input', to expose the low- 
dimensional dynamics of the driven process. In a regime 
which is periodic in the noise-free case (a = 3. Fig. HP), 
/j, is greatly reduced. The residual value reflects the fi- 
nite number of embedding points used and decreases with 
increasing N. Note however, the driving input noise sam- 
ples parts of the state space which are off the attractor, 
and in general, /i is not expected to be the same as that 
of the noise-free case. For example, with driving noise, a 
nonlinear system can spend large amounts of time near 
chaotic repellors in the phase space In the synapse 
the 'unperturbed' or unstimulated dynamics is trivially 
a fixed point of amplitude zero. 



IV. SYNAPTIC TRANSMISSION DATA 



We carried out whole cell patch-clamp recordings in 
21 pairs of synaptically-connected layer 2/3 pyramidal 
neurons (Fig. 0J3), using standard techniques [lq. The 
amplitude of synaptic events showed a typical pattern 
of variability in repeated responses to short bursts, and 
short-term depression in the ensemble average (Fig. |2K) . 
Next, presynaptic APs were stimulated continuously for 
periods of 30 minutes, with presynaptic spike timing de- 
termined by an inhomogeneous Poisson process the 
rate of which was modulated in exponentially-decaying 
bursts (peak amplitude R p , time constant Tb), at times 
generated by a stationary Poisson process of rate \ 
(Fig.|3p). Such a process is thought to model the statis- 
tics of natural bursting synaptic input reasonably well, 
and can have a coefficient of variation of interspike in- 
tervals [CV(ISI)] greater than 1 18]. Postsynaptic re- 
sponses to this stimulus train showed a high variability 
in amplitude, including a large proportion of failures, as 
well as asynchronous spontaneous events (Fig. EP). Dis- 
tributions of At and A are shown in Fig.|3jD and Fig.[3pl. 
Over 30 minutes of continuous stimulation at an average 
rate of 1.2 Hz, there is typically a small depressing trend 
in the average response amplitude, referred to as long- 
term depression [l9j . 
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FIG. 4: Clustering of amplitudes of responses with reliable 
futures. A: The history vector was defined only by the last in- 
terspike interval and last EPSP amplitude. Points are colour 
coded according to the dispersion value (see text) as indicated 
on the right using 50 nearest neighbours. Stimulus parame- 
ters were R pea k = 30 Hz, Th = 200 ms Xt = 0.2 Hz, which 
amount to an average rate of 1.2 Hz. B: Control for A using 
a random permutation of the amplitude time series. 

A. Dispersion of future synaptic transmissions 

First, we show evidence of nonlinear structure in 
the highly variable input-output relationship of these 
synapses. To do this we searched for histories hi with the 
most reliable futures Ai + i (see Eqn[2J. As a measure of 
the similarity between two histories, we used the Euclid- 
ian distance between their history-vectors after normal- 
izing amplitude and interspike interval dimensions. For 
each event of the time series we computed A4 (hi) , the set 
of the k nearest neighbors of hi 20] . The dispersion of the 
future output for a trajectory hi can be characterized by 
<7i, the standard deviation of the futures A4(hi) and a a 
the standard deviation of A. A simple example of this 
analysis, which can be easily visualized, is to distinguish 
which combinations of most recent interspike interval and 
EPSP amplitude lead to small dispersions. The results 



are presented in Fig.^jY. In the right hand panel the dis- 
tribution of all points in this space is shown (the range 
of the axes excludes failures). Points are colored accord- 
ing to their dispersions. Points with relatively reliable 
futures (low dispersion) are yellow or red. It is striking 
that the amplitude dimension of such points has a much 
tighter distribution than that of all amplitudes (see his- 
togram in the left panel), and that values are clearly re- 
stricted to a few sharp peaks. This pattern was seen in 
7 out of 8 synapses analyzed in this way. Shuffled surro- 
gates (see Fig. 0)3) never showed a similar pattern. Thus, 
within the complex and variable response of the synapse, 
a subset of patterns are transmitted with considerable 
precision. In this case for intervals less than the vesicle 
replenishment time constant of the synapse 0, El , the 
amplitude of the preceding event has a greater impact 
than the interval. The entropy that we have defined 
above gives a global characterization of dispersion over 
all histories of input-output. 



B. Correlation entropy of synaptic data 

Fig. 0\ shows a typical portrait of the dependence of 
fi on the neighborhood size, e. As e — > 0, /i converges to 
a constant plateau value (solid black line) . In surrogates 
where the output values are randomly shuffled, to destroy 
all correlations in the output, or shifted in time to destroy 
only the correspondence between the input and output, 
while preserving the correlations within the input and 
output individually, [i continues to grow as e — » 0. The- 
oretically this should approach oo, but is prevented from 
doing so by the large number of zeros (failures) in the 
amplitude distribution (Fig.Qfl). The small difference be- 
tween the two surrogates described above indicates that 
there is little additional correlation in the output which 
is independent from the input, i.e. the synapse is highly 
driven, in this case. Thus, a converging value for fi for 
small e is clearly identifiable in cortical synapses, even 
for stochastic input patterns, and is a measure of the 
uncertainty produced by synaptic transmission. 

[A, being a measure of the information rate of the 
input-output dynamics of the synapse, ought to change 
when the properties of the synapse are altered via long- 
term plasticity, which is believed to underlie learning 
and memory. To test this, we applied a presynaptic- 
postsynaptic paired stimulus protocol [2^, , in which 
pre and postsynaptic APs are repeatedly stimulated with 
a 10 ms delay between them to allow coincident arrival of 
both at the synaptic terminal. After this so-called 'spike- 
timing-dependent' long-term potentiation, /i showed a 
similar form to the control distribution, but a clear shift 
to lower values in the low e limit (Fig. 03). In this sense, 
less uncertainty is being created by the synaptic trans- 
mission for the same statistics of input, i.e. reliability of 
transmission is enhanced for this stimulus process. Sim- 
ilar findings were seen in 5 synaptic connections. 
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FIG. 5: Convergence of AVentropy estimate [i for synap- 
tic data. A: A typical fi(e) relationship at a very small 
5 = 0.018ms. A clear convergence is seen as e — > 0. Stim- 
ulation parameters as in Fig. 1. Total number of stimulation 
events in the time series was 2594. The mean of 50 randomly 
shuffled controls is shown as a dashed line. The standard de- 
viation g of these controls was maximal for e — > 0, a < 0.18. 
Gray o denotes the mean of 50 surrogates with a large shift 
between the amplitude and interspike interval time series (see 
text). A shift > 10 minutes was randomly chosen, a < 0.43 
B: fj,(e) before and after induction of spike-timing dependent 
plasticity (STDP). Gray line denotes the data before the in- 
duction of STDP, black solid line denotes after induction. The 
means of 50 randomly shuffled controls are shown as corre- 
sponding dashed lines, a < 0.44 before STDP and a < 0.43 af- 
ter STDP. Stimulation parameters were R = 30Hz Xb = 0.5Hz 
76 = 400ms, average rate 6 Hz. The stimulation before and 
after STDP induction was identical, with 3000 stimulation 
events. 



C. A biophysical model of short-term plasticity 



The iterative solution for a train of spikes arriving at one 
release site is given by 

P v (ts i+1 )=P v (tSi)-(l-U ae ) 

x p -(ts i+1 -tSi)/T rcc ^ _ g-(ts <+ l— tSjJ/Trec (O,) 

where is, is the i th spike time, and P r (tsi) = U se ■ P v (tsi) 
denotes the probability of release for each release site at 
the time of a spike is, . 

However, individual trajectories follow a different dynam- 
ics from the ensemble since at each spike time ts an all- 
or-nothing stochastic decision is made on the availabil- 
ity of a vesicle, and therefore the release probability set 
back to zero if release occurs. Thus individual realiza- 
tions follow an abruptly changing, nonlinear stochastic 
map. Individual trajectories were simulated as follows: 
for each individual release site, the times of the most re- 
cent transmitter release (tri) are recursively defined for 
a given input time series of spike times (tsi) 

tr l+ i =tr. L + (tSj+i - tr^ 

x e(t«i+i - t n - Ti)Q{U se - (10) 

with the associated refilling intervals: 

r i+ i = UiQ(tr i+ i - tri) + T t Q(tn - tr i+ i) (11) 

where H is a random number from an exponential dis- 
tribution with a time constant T rec (see |HJ , & a random 
number from a uniform distribution in the interval [0; 1], 
and 



To gain insight into possible underlying mechanisms, 
we also carried out the same analysis on a stochas- 
tic biophysically-based microscopic model of cortical 
synapses adapted from | 24| . In this model, which is con- 
sistent with a mean-field deterministic model of short- 
term plasticity the stochastic release and replenish- 
ment of a small pool of transmitter vesicles ('quanta') is 
simulated explicitly, with Gaussian variability of vesicle 
amplitude. The synaptic connection is composed of N 
release sites. At each site there may be, at most, one 
vesicle available for release, and the release from each 
of the sites is independent of the release from all other 
sites. The dynamics is characterized by two probabilis- 
tic processes, release and recovery. At the arrival of a 
presynaptic spike at time ts, each site containing a vesi- 
cle will release the vesicle with the same probability, U se 
(use of synaptic efficacy). Once a release occurs, the 
site can be refilled (recovered) during a time interval At 
with a probability 1 — e -At/r rcc ^ T ^ ag a recover y 

time constant. Both processes can be described by a sin- 
gle differential equation, which determines the ensemble 
probability, , for a vesicle to be available for release at 
any time t [24j . 

^ = — ~ U se ■ Pv ■ S(t - ts) (8) 



af \ / x<0 an /0a;<0 
e ^ = { 1 x > ' ®W = (li>0 

The postsynaptic response a, to a single vesicle release is 
assumed not to be a constant value but randomly drawn 
from a Gaussian distribution characterized by the coeffi- 
cient of variation of the quantal content CV(q) — a q /m q . 

a>i = Ci<J q + m q (12) 

where Q is a random number from Gaussian distribution 
with mean and a standard deviation of 1, and a q is 
the standard deviation and m q the mean of the quantal 
content. Negative values for <2j were rounded to zero. 
The final size of a postsynaptic response Aj is the sum 
over all release sites 

A i+1 = J2 a i®(tri+i-tri) (13) 
i=i 

In summary the model depends upon three stochastic 
processes, the recovery time for vesicles r,-, the decision 
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FIG. 6: A: Analysis of a biophysically-based model of synap- 
tic transmission |24|, driven by the same stimulus timing as 
used in Fig. [SJV. The model parameters were: Use = 0.5, 
Tree = 800 ms, N — 5, the mean quantal size q = 0.2 
mV for all release sites, see |24j| for details. Graphs are 
shown for three different levels of variability of the quantal 
content. B: Same analysis as in A but with a logarithmic 
scale in e to demonstrate the divergence between the macro- 
scopic mean-field model with additional extrinsic Gaussian 
noise (solid line) and the microscopic stochastic model (dot- 
ted line). The standard deviation of the Gaussian noise was 
estimated from average ensemble fluctuations of 1000 surro- 
gates of the stochastic model (parameters as in A). The model 
parameters for the deterministic model were chosen accord- 
ingly: Use = 0.5, Ase = 1, Tree = 800mS. 

whether to release Q(U se — £i), and the amount of trans- 
mitter released Oj. 

This model was able to reproduce a convergence of 
/t(e) for physiologically realistic parameters (Fig. 
although not as flat as the experimental data. When 
quantal variability was reduced to very low values, 
step-like patterns were observed in the //(e) relationship, 
reflecting a reliable quantal representation (i.e. number 
of quanta) of EPSP amplitude. This indicates that the 
convergence of /t for real data might reflect deterministic 
predictability of quantal number. When we analyzed 
the corresponding macroscopic or mean-field model |l| 
with additive Gaussian noise of the same amplitude 
as the average ensemble fluctuations, a very different 
pattern of //(e) was observed (Fig. EJ3). Instead of 
convergence at low e, \x rose sharply to arbitrarily high 
values as e — > 0. Thus the signature of this uncorrelated 
extrinsic noise added to the mean-field dynamics is quite 
different again from what is observed in the experimental 
data. The convergence of // both in actual data and 
in the microscopic biophysical model, but not for the 



mean-field case with extrinsic noise, implies that the 
intrinsic microscopic nature of synaptic transmission 
leads effectively to a state of low-dimensional chaos. 

Any classification of the nature of the dynamics in 
this way as chaotic or stochastic, using real time series 
of finite length, actually depends on the scale of e and 
5 and the length of data available [25J. In the nervous 
system, the postsynaptic cell has a limited resolution for 
distinguishing the amplitude (set by intrinsic channel 
gating noise) and timing (set by jitter in synaptic 
latencies) of individual synaptic events. These resolution 
limits, or the effective granularity of representation of 
amplitude and timing, will vary according to the location 
of the synapse on the dendritic tree and the state of 
activation of ion channels, which together determine the 
spatial and temporal filtering of inputs. Thus, the scale 
or e,<5-dependence, of the correlation entropy measure 
should be meaningful physiologically in understanding 
the generation and flow of information in a neural circuit. 

Previous work has characterized synaptic reliability us- 
ing very low frequency single pulse trials (e.g. (23) or 
as the ensemble responses to short bursts of APs (e.g. 
[J H2I In contrast, the correlation entropy 

K2 gives a measure of the overall nonlinear predictabil- 
ity of the microscopic input-output mapping of a synapse 
- driven by a particular, but arbitrary stimulus pattern, 
which can be calculated practically from synaptic data. 
It also has a simple information-theoretical interpretation 
as the rate of information or uncertainty production by 
a synapse. Therefore, it is a natural measure for charac- 
terizing the dynamic reliability of a synapse during natu- 
ral activity. Applying it to experimental results suggests 
that the microscopic characteristics of transmitter release 
and postsynaptic receptor kinetics, combined with a com- 
plex natural- like input timing, lead to a stochastic chaotic 
process at individual cortical synapses, at certain scales 
of resolution. 
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